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Abstract 



We prove that the join of two sets may actually fall into a lower level of the extended 
low hierarchy JBBS86 ] than either of the sets. In particular, there exist sets that are not 
in the second level of the extended low hierarchy, EL2, yet their join is in EL2. That is, 
in terms of extended lowness, the join operator can lower complexity. Since in a strong 
intuitive sense the join does not lower complexity, our result suggests that the extended 
low hierarchy is unnatural as a complexity measure. We also study the closure proper- 
ties of EL2 and prove that EL2 is not closed under certain Boolean operations. To this 
end, we establish the first known (and optimal) EL2 lower bounds for certain notions 
generalizing Selman's P-selectivity [ |Sei79 ], which may be regarded as an interesting 
result in its own right. 



1 Introduction 



The low hierarchy ftSch83[ ] provides a yardstick to measure the complexity of sets that are known to 
be in NP but that are seemingly neither in P nor NP-complete. In order to extend this classification 



beyond NP, the extended low hierarchy [BBS86] has been introduced (see the surveys [ Kob95 



Hem93| ]). An informal way of describing the intuitive nature of these hierarchies might be the 
following: A set A that is placed in the kth level of the low or the extended low hierarchy contains no 
more information than the empty set relative to the computation of a £? machine (see [ MS72 , Sto77| ] 
for the definition of the S levels of the polynomial hierarchy), either because A is so chaotically 
organized that a TP k machine is not able to extract useful information from A, or because A is 
so simple that it has no useful information to offer a Y? k machine.[] The low and extended low 
hierarchies have been very thoroughly investigated in many papers (see, e.g., [ Sch83 , KS85 , BBS86| , 
Sch87| , [Sch89l , ^o9Tj pj92[ , |ABG| , |K6b94| , |SL9~4i [HNOS96| ]). In light of the informal intuition 
given above — that classifying the level in the extended low hierarchy of a problem or a class gives 
insight into the amount of polynomial-hierarchy computational power needed to make access to the 
problem or the class redundant — one main motivation for the study of the extended low hierarchy 
is to understand which natural complexity classes and problems easily extend the power of the 
polynomial hierarchy and which do not. Among the important natural classes and problems that 
have been carefully classified in these terms are the Graph Isomorphism Problem (which in fact 
is known to be low), bounded probabilistic polynomial time (BPP), approximate polynomial time 
(APT), the class of complements of sets having Arthur-Merlin games (coAM), the class of sparse 
and co-sparse sets, the P-selective sets, and the class of sets having polynomial-size circuits (P/poly). 
Another motivation for the study of the low and extended low hierarchies is to relate their properties 
to other complexity-theoretic concepts. For instance, Schoning showed that the existence of an NP- 
complete set (under any "reasonable" reducibility) in the low hierarchy implies a collapse of the 
polynomial hierarchy [Sch83]. Among the most important recent results about extended lowness 



We stress that this is a very loose and informal description. In particular, for the case of the extended low hierarchy, 
it would be more accurate to say: A set A that is placed in the (k + l)st level of the extended low hierarchy, k > 1, is 
such that NP A contains no more information than SAT © L relative to the computation of a EJJ machine. 
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are Sheu and Long's result that the extended low hierarchy is a strictly infinite hierarchy [ |SL94 ] and 
Kobler's optimal location of P/poly in the extended low hierarchy [ Kob94 ]. In this note, we seek 
to further explore the structure of the extended low hierarchy by studying its interactions with such 
operations as the join. In particular, we prove properties of EL2 with regard to its interaction with 
the join and with Boolean operations. Our results add to the body of evidence that extended lowness 
does not provide a natural, intuitive measure of complexity. 

In light of the many ways in which extended lowness captures certain concepts of low infor- 
mation content (such as all sparse sets and certain reduction closures of the sparse sets — e.g., the 
Turing closure of the class of sparse sets, which is known to be equal to P/poly) as well as certain 
concepts of "almost" feasible computation (such as BPP, APT, and P-selectivity, etc.), it might be 
tempting to assume that extended lowness would provide a reasonable measure of complexity in the 
sense that a problem's property of being extended low indicates that this problem is of "low" com- 
plexity. However, in Section ||, we will prove that the join operator can lower difficulty as measured 
in terms of extended lowness: There exist sets that are not in EL2, yet their join is in EL2. Since in a 
strong intuitive sense the join does not lower complexity, our result suggests that, if one's intuition 
about complexity is — as is natural — based on reductions, then the extended low hierarchy is not a 
natural measure of complexity. Rather, it is a measure that is related to the difficulty of information 
extraction, and it is in flavor quite orthogonal to more traditional notions of complexity. That is, our 
result sheds light on the orthogonality of "complexity in terms of reductions" versus "difficulty in 
terms of non-extended-lowness." In fact, our result is possible only since the second level of the 
extended low hierarchy is not closed under polynomial-time many-one reductions (this non-closure 
is known, see [ AH92], and it also follows as a corollary of our result). 

In Section [| we apply the technique developed in the preceding section to prove that the second 
level of the extended low hierarchy is not closed under the Boolean operations intersection, union, 
exclusive-or, and equivalence. Our result will follow from the proof of another result, which estab- 
lishes the first known (and optimal) EL2 lower bounds for generalized selectivity-like classes (that 
generalize Selman's class of P-selective sets [ Sel79 ], denoted P-Sel) such as the polynomial-time 
membership-comparable sets introduced by Ogihara [Ogi95] and the multi-selective sets introduced 
by Hemaspaandra et al. [ HJRW96| ]. These results sharply contrast with the known result that all P- 
selective sets are in EL2 and they are thus interesting in their own right. 



2 Extended Lowness and the Join Operator 

The low hierarchy and the extended low hierarchy are defined as follows. 

Definition 1 1. [ jSch83| ] For each k > 1, define Low fc = {L G NP | E£ L = TF k }. 

2. QBBS86| ] For each k > 2, define EL k = {L | = E^®^ 7 }, where SAT is the set of 
all satisfiable Boolean formulas. 

For sets A and B, their join, A © B, is {Ox | x G A} U {lx | x £ B}. Theorem |2| below 
establishes that the join operator can lower the difficulty measured in terms of extended lowness. 
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At first glance, this might seem paradoxical. After all, every set that <m-reducesf[] to a set A or B 
also reduces to A © B, and thus intuition strongly suggests that A © B must be at least as hard as 
A and B, as most complexity lower bounds (e.g., NP-hardness) are defined in terms of reductions. 
However, extended lowness merely measures the opacity of a set's internal organization, and thus 
Theorem || is not paradoxical. Rather, Theorem || highlights the orthogonality of "complexity in 
terms of reductions" and "difficulty in terms of non-extended-lowness." Indeed, note Corollary ||, 
which was first observed by Allender and Hemaspaandra (then Hemachandra) [ AH92| ]. We interpret 



Theorem || as evidence that extended lowness is not an appropriate, natural complexity measure with 
regard to even very simple operations such as the join. 

Theorem 2 There exist sets A and B such that A EL 2 and B £ EL 2 , and yet A © B G EL 2 . 

Lemma || below will be used in the upcoming proof of Theorem |2| First, we fix some notations. 
Fix the alphabet £ = {0, 1}. Let S* denote the set of all strings over E. For each set L C 
£*, L =n (L- n ) is the set of all strings in L having length n (less than or equal to n), and ||L|| 
denotes the cardinality of L. Let S n be a shorthand for (S*) =n . Let <i ex denote the standard quasi- 
lexicographical ordering on £*. The census function of a set L is defined by censusL(0 n ) = \\L- n \\. 
L is said to be sparse if there is a polynomial p such that for every n, census l(0™) < p(n). Let 

SPARSE denote the class of all sparse sets. For each class C of sets over S, define coC = {L | L G 
C}. Let IN denote the set of non-negative integers. To encode a pair of integers, we use a one-one, 
onto, polynomial-time computable pairing function, (-, •) : IN x IN — ► M, that has polynomial-time 
computable inverses. FP denotes the class of polynomial-time computable functions. We shall use 
the shorthand NPTM to refer to "nondeterministic polynomial-time Turing machine." For an NPTM 
M (an NPTM M and a set A, respectively), L(M) (L(M )) denotes the set of strings accepted by 
M (relative to A). 

Lemma 3 If F is a sparse set and census p G FP F ® SAT , then F G EL 2 . 

Proof. Let L G NP NpF via NPTMs Ni and N 2 , i.e., L = L(N^ N ^). Let q(n) be a polynomial 

L< N F ) 

bounding the length of all queries that can be asked in the run of N 1 2 on inputs of length n. 
Below we describe an NPTM N with oracle F © SAT: 

On input x, \x\ = n, N first computes censusF^ 1 ) for each relevant length i < q(n), and then 
guesses all sparse sets up to length q(n). Knowing the exact census of F, N can use the F part of 
its oracle to verify whether the guess for F- q ^ is correct, and rejects on all incorrect paths. On 
the correct path, iV uses itself, the SAT part of its oracle, and the correctly guessed set F- q ^ to 

L(N F ) 

simulate the computation of N l 2 on input x. 

Clearly, L(A^ F ® SAT ) = L. Thus, NP NpF C NP FffiSAT , i.e., F G EL 2 . □ 

Proof of Theorem g. A = \J i>0 A { and B = \J i>0 B { are constructed in stages. In order to 
show A g" EL 2 and B €" EL 2 it suffices to ensure in the construction that NP^ 4 % coNP j4 ® SAT and 
NP B % coNP B © SAT (and thus, NP NpA % NP A ® SAT and NP NpS % N P B © SAT ). 

2 For sets X and Y, X Y if and only if there is a polynomial-time computable function / such that 

X = {x | f(x) e Y}. 
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df df o2^ — ) 

Define function i inductively by t(0) = 2 and t(i) = 2 for i > 1. Let {A^}j>! be a 

fixed enumeration of all coNP oracle machines having the property that the runtime of each iVj is 
independent of the oracle and each machine appears infinitely often in the enumeration. Define 

L A = {0^ | (3j>l)[i = (0,j) A ||Ans*W|| > 1]}, 

L B 1 {0'« | (3j > 1) [i = (1, j) A ||S n S*«|| > 1]}. 

Clearly, La € NP" 4 and Lb € NP B . In stage i of the construction, at most one string of length t(i) 
will be added to A and at most one string of length t(i) will be added to B in order 

(1) to ensure L(Nf i@SAT ) ^L A ifi= (0, j) (or L(iV^® SAT ) ^ L B , respectively, if* = (1, j)), 

and 

(2) to encode an easy to find string into A if i = (or into B if i = {0,j}) indicating whether 

or not some string has been added to B (or to A) in (1). 

Let and -Bj_i be the content of A and B prior to stage i Initially, let Aq = Bq = 0. Stage i is 
as follows: 

First assume i = (0, j) for some j > 1. If it is the case that no path of Nj *- 1 ® SAT (o*(*)) can 

query all strings in E*W — {O 4 ^)} and A^ 8_1 ® SAT (0*W) cannot query any string of length i(i + 1) 
(otherwise, just skip this stage — we will argue later that the diagonalization still works properly), 

. 1 (T) SAT +( '\ 

then simulate N- l ~ on input «. If it rejects (in the sense of coNP, i.e., if it has one or more 
rejecting computation paths), then fix some rejecting path and let Wi be the smallest string in E*W — 
{0* (i) } that is not queried along this path, and set A { := U {wi} and B, L := B{-\ U {0*^}. 
Otherwise (i.e., if 0*W g L(7V 7 Al ' 1 ® SAT )), set Ai := A^ x and B, := B^ X - The case of i = 
is analogous: just exchange A and B. This completes the construction of stage i. 

Since each machine iVj appears infinitely often in our enumeration and as the t(i) are strictly 
increasing, it is clear that for only a finite number of the , 7Vj 2 , . . . that are the same machine as 
N{ can it happen that stage i\. must be skipped (in order to ensure that Wi k , if needed to diagonalize 
against Ni k , indeed exists, or that the construction stages do not interfere with each other), and thus 
each machine iVj is diagonalized against eventually. This proves that A EL2 and B EL2. Now 
observe that A © B is sparse and that census a® b £ FP" 4 ® 5 . Indeed, 

census A(S B(0 n ) = 2(\\A n {0, 00, . . . ,0 n_1 }|| + ||J3 n {0, 00, . . . ,0' t_1 }||). 

Thus, by Lemma |i®5e EL 2 . □ 

Corollary 4 [ |\H92 ] EL2 is not closed under <m-reductions. 

In contrast to the extended low hierarchy, every level of the low hierarchy within NP is clearly 
closed under <m-reductions. Thus, the low hierarchy analog of Theorem [| cannot hold. 

Fact 5 (VA; > 0) (VA, B) [(A Low fe \J B £ Low fc ) A © B g Low fc ]. 
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Proof. Assume A © B G Low fe . Since for all sets A and B, A <m A®B and B <? m A © B, the 
closure of Low^ under <m-reductions implies that both A and B are in Low^. □ 

One of the most interesting open questions related to the results presented in this note is whether 
the join operator also can raise the difficulty measured in terms of extended lowness. That is, do 
there exist sets A and B such that A G and B G EL&, and yet A © B g" EL& for, e.g., k = 2? Or 
is the second level of the extended low hierarchy (and more generally, are all levels of this hierarchy) 
closed under join? Regarding potential generalizations of our result, we conjecture that Theorem || 
can be generalized to higher levels of the extended low hierarchy. Such a result, to be sure, would 
probably require some new technique such as a clever modification of the lower-bound technique 
for constant-depth Boolean circuits developed by Yao, Hastad, and Ko (see, e.g., ]Has89| , |Ko91| ]). 



3 EL 2 is not Closed Under Certain Boolean Connectives 

In this section, we will prove that the second level of the extended low hierarchy is not closed 
under the Boolean connectives union, intersection, exclusive-or, or equivalence. We will do so 
by combining the technique of the previous section with standard techniques of constructing P- 
selective sets. To this end, we first seek to improve the known EL2 lower bounds of P/poly, the 



well-studied class of sets having polynomial-size circuits [KL80]. To wit, we will show that certain 
generalizations of the class of P-selective sets, though still contained in P/poly [ Ogi95 , HJRW96 ], 
are not contained in EL2. As interesting as this result may be in its own right, its proof will even 
provide us with the means required to show the above-mentioned main result of this section: EL2 is 
not closed under certain Boolean connectives (and indeed P-selective sets can be used to witness the 



non-closure). This extends the main result of Hemaspaandra and Jiang [HJ95], namely that P-Sel is 
not closed under those Boolean connectives. 

Let us first recall the following generalizations of Selman's P-selectivity. Ogihara inuo- 
duced the P-membership comparable sets [ pgi95 ] and the present paper 's authors ([ |HJRW96| |, see 



also [ Rot95| ]) introduced the notion of multi-selectivity as defined in Definition [7| 



Definition 6 JOgi95 ] Fix a positive integer k. A function / is called a /c-membership comparing 



function for a set A if and only if for every w\ , . . . , w m with m > k, 

f{wi, . . . ,w m ) G {0, l} m and (xaOi), ■ ■ ■ , XaK)) / f(m, ■ ■ ■ , w m ), 

where \A denotes the characteristic function of A. If in addition / G FP, A is said to be 
polynomial-time ^-membership comparable. Let P-mc(fc) denote the class of all polynomial-time 
fc-membership comparable sets. 

We can equivalently (i.e., without changing the class) require in the definition that 
f{wi, . . . , w m ) / (xa(wi), . . . , XA(w m )) must hold only if the inputs wi,...,w m happen to be 
distinct. This is true because if there are r and t with r ^ i and w r = wt, then / simply outputs a 
length m string having a "0" at position r and a "1" at position t. 
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Definition 7 Fix a positive integer k. Given a set A, a function / € FP is said to be an S(k)- 
selector for A if and only if / satisfies the following property: For each set of distinct input strings 
Vl, ■ ■ ■ ,Vn, 

1- f(yi, ■ ■ ■ , Vn) G {Vl, ■ ■ ■ ,Vn}> and 

2. if pn{yi,...,y n }|| > k, then f(yi,..., y n ) G A. 

The class of sets having an S(A;)-selector is denoted by S(k). 

It is easy to see that P-mc(l) = P and S(l) = P-Sel. Furthermore, though the hierarchies 
U fe P-mc(A;) and U fc S(fc) WQ properly infinite, they both are still contained in P/poly flOgi95 



[HJRW96 ]. Among a number of other results, all the relations between the classes P-mc(j) and 



S(k) are completely established in Hemaspaandra et al. [ EJRW96 [. These relations are stated in 



Lemma || below, as they'll be referred to in the upcoming proof of Theorem |9| 
Lemma 8 QHJRW96| ] 

1. P-mc(2) 2U>iS(fc). 

2. For each k > 1, S(k) C P-mc(fc + 1) and S(k) % P-mc(A;).0 

The following result establishes a structural difference between Selman's P-selectivity and 



the generalized selectivity introduced above: Though clearly S(l) = P-Sel C EL2 [|ABGJ and 



P-mc(l) = PC EL2, we show that there are sets (indeed, sparse sets) in S(2) D P-mc(2) that are 



not in EL2. Previously, Allender and Hemaspaandra [ |AH92| ] have shown that P/poly (and indeed 
SPARSE and coSPARSE) is not contained in EL2. Theorem ^ and Corollary [[(], however, extend 
this result and give the first known (and optimal) EL2 lower bounds for generalized selectivity-like 
classes. 

Theorem 9 SPARSE n S(2) n P-mc(2) % EL 2 . 

Proof. Let t be the function defined in the proof of Theorem || that gives triple-exponentially 
spaced gaps. Let T k = E*^, for k > 0, and T = \J k>Q T k . Let EE be defined as 
U c>0 DTIME[2 c2 "]. We will construct a set B such that 

(a) BQT, 

(b) B G EE, 

(c) \\B n TfeU < 1 for each k > 0, and 

(d) B # EL 2 . 



This genera lizes to k larger than 1 a result of Ogihara who proves that t he P- se lective sets are strictly contained in 



P-mc(2) ||Ogi95] as well as the known fact that P-Sel is strictly larger than P [Sel79] 
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Note that it follows from (a), (b), and (c) that B is a sparse set in S(2). Indeed, any input to 
the S(2)-selector for B that is not in T (which can easily be checked) is not in B by (a) and may 
thus be ignored. If all inputs that are in T are in the same then, by (c), the S(2)-promise (that B 
contains at least two of the inputs) is never satisfied, and the selector may thus output an arbitrary 
input. On the other hand, if the inputs that are in T fall in more than one T^, then for all inputs 
of length smaller than the maximum length, it can be decided by brute force whether or not they 
belong to B — this is possible, as B € EE and the Tk are triple-exponentially spaced. From these 
comments, the action of the S(2)-selector is clear. 

By Lemma ||, B is thus in P-mc(A;) for each k > 3. But since S(2) and P-mc(2) are incom- 
parable (again by Lemma ||), we still must argue that B € P-mc(2). Again, this follows from (a), 
(b), and (c), since for any fixed two inputs, u and v, if they are of different lengths, then the smaller 
one can be solved by brute force; and if they have the same length, then it is impossible by (c) that 
(xb(u), Xb(v)) = (1, 1). In each case, one out of the four possibilities for the membership of u 
and v in B can be excluded in polynomial time. Hence, B € P-mc(2). 

For proving (d), we will construct B such that NP S % coNP B ® SAT (which clearly implies that 
NP NpS 1 NP B ® SAT ). Define 

L B = {0 n | (3x) [\x\ = n A x € B}}. 

Clearly, Lb £ NP B . As in the proof of Theorem^, let {iVj}j>i be a standard enumeration of all 
coNP oracle machines satisfying the condition that the runtime of each Ni is independent of the 
oracle and each machine is repeated infinitely often in the enumeration. Let pi be the polynomial 

bound on the runtime of JVj. The set B = \J i>0 B t is constructed in stages. In stage i, at most one 
string of length m will be added to B, and will have previously been set to the content of B 
up to stage i. Initially, Bq = and no = 0. Stage i > is as follows: 

Let rtj be the smallest number such that (i) m > n»_i, (ii) = t(k) for some k, and (iii) 2 ni > 
Pi(rii). Simulate ivf i - 1 ® SAT (0 n *). 

Case 1: If N i 1-1 (0 TCi ) rejects (in the sense of coNP, i.e., if there are one or more rejecting 
computation paths), then fix some rejecting path and let wi be the smallest string of length m 
that is not queried along this path. Note that, by our choice of rij, such a string wi, if needed, 
must always exist. Set Bi := Bi-\ U {wi}. 

Case 2: If n * E L{N? l - lffiSAT ), then set B % := B^ x . 

B •_ ©SAT 

Case 3: If the simulation of N i '~ on input ni fails to be completed in double exponential 
(say, 2 100 ' 2 " 1 steps) time (for example, because Ni is huge in size relative to ni), then abort 
the simulation and set Bi := Bi-\. 

This completes the construction of stage i. 

Since we have chosen an enumeration such that the same machine as N appears infinitely often 
and as the ni are strictly increasing, it is clear that for only a finite number of the N^, N 2 , . . . that 
are the same machine as N can Case 3 occur (and thus Ni, either directly or via one of its clones, 
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is diagonalized against eventually). Note that the construction meets requirements (a), (b), and (c) 
and shows L B ^ L{Nf ® SAT ) for each i > 1. □ 

Since EL 2 and P-mc(2) are both closed under complementation, we have the following corol- 
lary. 

Corollary 10 coSPARSE n coS (2) n P-mc(2) % EL 2 . 

When suitably combined with standard techniques of constructing P-selective sets, the proof of 
the previous theorem even proves that the second level of the extended low hierarchy is not closed 
under a number of Boolean operations, as we have claimed in the beginning of this section. These 



results extend the main result of Hemaspaandra and Jiang [ |HJ95| ] which says that P-Sel is not closed 
under those Boolean connectives. 



Let us first adopt and slightly generalize some of the formalism used in QHJ95Q so as to suffice 
for our objective. The intuition is that we want to show that certain widely-spaced and complexity- 
bounded sets whose definition will be based on the set B constructed in the previous proof are 
P-selective. Fix some complexity-bounding function / and some wide-spacing function \i such 
that the spacing is at least as wide as given by the following inductive definition: /i(0) = 2 and 
p,(i + 1) = 2fW?> for each i > 0. Now define for each k > 0, 

R k 1 {i | % e JN A n(k) <i< n{k + 1)}, 

and the following two classes of languages (where we will implicitly use the standard correspon- 
dence between S* and IN): 

d = {AQJN\ (Vj > 0) [R 2j n A = A (Vz, y G R 2j+1 ) [(x < y A x G A) => y G A]]}; 

C 2 = {A C IN | (Vj > 0) [R 2j n A = A (Vx, y G R 2j+1 ) [(x < y A y G A) => x G A}}}. 

In [ ]HJ95[ ], the following lemma is proven for the particular complexity -bounding function 
fin) = 2°^ and for the classes C'± and C' 2 having implicit in their definition the particular wide- 
spacing function that is given by //(0) = 2 and p!(i + 1) = 2 2<M W) , i > 0. However, there is 



nothing special about these functions /' and //, i.e., for Lemma 11 to hold it suffices that / and \i 



relate to each other as required above. In light of this, the proof of Lemma 1 1 is quite analogous to 



the proof given in [HJ95]. 



Lemma 11 d n DTIMEf/] C P-Sel and C 2 n DTIME[/] C P-Sel. 

Now we are ready to prove the main result of this section. 
Theorem 12 EL 2 is not closed under intersection, union, exclusive-or, or equivalence. 
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Proof. Using the technique of [HJ95], it is not hard to prove that the set B constructed in the 
proof of Theorem |9] can be represented as B = A\ n A2 for P-selective sets A\ and A%. More 
precisely, let 



A 2 



df 
df 



{x I (3w € B) [\x\ 
{x I (3w G B) [\x\ 



\M A X <iex W]}, 
\w\ A W <iex x}}. 



Since 1? G EE and is triple-exponentially spaced, we have from Lemma [TTj that A\ and A2 are in 
P-Sel and thus in EL2. On the other hand, we have seen in the previous proof that B = A% D A2 is 
not in EL2. Similarly, if we define 



C-i 

Co 



df 
df 



{x I (3w € -B) [\x\ 
{x I (3w G B) [\x\ 



\M A X <lex W}}, 
\w\ A X <lex W}}, 



we have i? = C% A C2, where A denotes the exclusive-or operation. As before, C% and C2 are in 
P-Sel and thus in EL2. Hence, EL2 is not closed under intersection or exclusive-or. Since EL2 is 
closed under complementation, it must also fail to be closed under union and equivalence. □ 

The proof of the above result also gives the following corollary. 
Corollary 13 [ HJ95 ] P-Sel is not closed under intersection, union, exclusive-or, or equivalence. 
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